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I. DISCRETE ADAPTIVE GAMES 
A. Introduction 

In the last few years, physicists have become very inter- 
ested in discrete games. In these models, a finite number 
of players or agents pick from a finite set of actions (pos- 
sibly varying from agent to agent), at discrete times, and 
receive rewards that depend on their own and the other 
agents' actions. Each agent chooses according to a rule 
called its strategy; if agents have more than one strategy 
available, they use a meta-strategy to chose among them. 

As described, the setting fits classical game theory 
P, Q, with its assumption of so-called substantive ra- 
tionality — the agents have rational, accurate expecta- 
tions, enjoy common knowledge of the structure of the 
game, and act so as to maximize their reward. Casual 
observation suggests this is not a good model of human 
behavior, and indeed experimental psychology |3l and ex- 
perimental economics ^ both reject it decisively. Fail- 
ing substantive rationality, one turns to some form of 
bounded rationality — agents still pursue goals, but 
are limited by finite knowledge and finite cognitive ca- 
pacities, and so cannot, in general, maximize anything. 
Bounded rationality is the subject of a rich literature 
in the social sciences, which encompasses both abstract 
models some of which exploit familiar methods of 
statistical physics 0, and a rapidly-growing experimen- 
tal literature, which includes its own array of models 
0, 1^ ITol Hll . While the econophysical literature almost 
exclusively considers boundedly-rational agents, it never 
builds upon other work on bounded rationality. For in- 
stance, one of the best-supported meta-strategies is that 
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of satisficing, in which an agent searches over its options 
and takes the first one it finds with a satisfactory reward 
[T^ IT^l IT^ . We are unable to find a single paper which 
employs this notion. Econophysical strategies are all, so 
far as we know, of the following form. Each agent remem- 
bers a simple summary statistic (e.g., the best action to 
have taken) for each of the last m turns of the game. For 
each such history, a strategy specifies an action to take. 
Rather than maximizing, or even satisficing, they employ 
adaptive meta-strategies tending to select strategies that 
did well in the recent past. 

These caricatures or toy models have been studied 
since the 1980s, because, it is said, they (1) shed light on 
real learning and mutual adaptation, and (2) show sur- 
prisingly complex behavior. In this paper, we examine 
two forms this complexity is held to take — determinis- 
tic chaos, which is a sort of dynamical complexity, and 
formally measured complexity, specifically the amount of 
information embedded in the system. The rest of this sec- 
tion describes the most popular discrete adaptive games, 
the minority game and the El Farol Bar problem. The 
next section introduces the tools from symbolic dynam- 
ics, particularly subshifts of finite type, which we will 
use to pry open the mechanisms of these games. We 
show that the games are non-chaotic, and put linear up- 
per bounds on their complexities. We discuss how to 
extend our results to games with either memories of un- 
limited length, or noisy play. We then consider what you 
must do to a game to make it chaotic, if you want it to 
be chaotic. In closing, we suggest a way to reconcile our 
findings with common observations on these games. 



B. Examples: El Farol and the Minority Game 

The best-loved game in econophysics_ is the 

minority game of Challet and Zhang the 
subject of a rapidly growing literature (see 
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http : / /vm . unif r . ch/ econophysics/minority/) . 

There are N agents, each of which can make only one of 
two moves: play "0" or play "1". If most agents play 0, 
then those who play 1 win, and vice-versa. {N is always 
odd.) Each player remembers whether or 1 won on 
each of the last m turns. Strategies, again, are rules 
mapping histories to actions; each agent has s of them. 
In effect, strategies must predict what most players will 
do, and then do the opposite. Agents keep track of how 
many times each of their strategies would have won, and 
use the strategy with the best record over the time it can 
remember. (Note that psychologists have studied human 
performance in just such discrete prediction situations 
since the 1950s, without finding anything resembling this 
learning mechanism T^.) Ties between strategies are 
broken randomly or pseudo-randomly, say by assigning 
strategies a random order at the beginning of the game. 

Traditionally, the minority game has been studied ei- 
ther using the brute empiricism of simulations, or with 
statistical-mechanical methods, particularly those em- 
ploying the thermodynamic limit. Recently, Jefferies, 
Johnson et al. have introduced methods owing more to 
dynamical systems, e.g., de Bruijn graphs over possible 
sequences of winning outcomes [13, uM- Our approach 
here is related to theirs, but is even more deterministic, 
and more microscopic. 

The minority game descends from W. B. Arthur's El 
Parol Bar Problem There are 100 people in Santa 
Fe who go out to bars; El Parol is the only good bar. 
Normally, those who go there are better off than those 
who stay home and watch the stars. But El Parol is 
small, and if more than 40 people go, crowding makes 
the bar-goers worse off than stay-at-at-homes. Everyone 
knows how many people went to the bar on each of the 
last 771 nights. Strategies, again, map histories to actions 
— staying home or going to the bar. 

Rather than statistical mechanics, the traditional ap- 
proaches to the El Parol problem are those of evolu- 
tionary adaptation and inductive behavior. Many have 
sought to show that either the population of agents co- 
evolves a set of mutually-tolerable strategies, or that a 
ceaseless evolutionary arms race forces ever yon e to "run 
as fast as they can just to stay in place" P.ll9l|. 



II. SYMBOLIC DYNAMICS, SHIFTS 

Symbolic dynamics is one of the basic analytical meth- 
ods of nonlinear dynamics and complex systems, and as 
such its elements are discussed in standard introduct ory 
textbooks on those subjects (e.g., Refs. [l^,!!!!!!!!!!! 
W^). Strangely, however, it does not seem to have been 
applied to discrete adaptive games before. We there- 
fore give a few words of motivation, before presenting 
some basic notions and results. Readers whose curiosi- 
ties are aroused will find Refs. 0| and particularly 
nice introductions, emphasizing uses in nonlinear dynam- 
ics and complexity, respectively. Refs. ||2Q] and [2^] more 



advanced treatments. 



A. Why Symbolic Dynamics? 

The essence of symbolic dynamics is substituting 
strings of discrete characters or symbols for trajectories 
in an original continuous state space. Motion in the orig- 
inal space corresponds simply to shifting along the string. 
This idea goes back to work by Morse and others in the 
1930s. One of its first great successes came in a paper by 
Smale 28] which introduced his famous "horseshoe" , and 
established the geometry of what we now call chaotic dy- 
namics. Smale first constructed a differentiable, invert- 
ible map / on a two-dimensional manifold M , which, 
while it has a very simple functional form, has almost im- 
possibly complicated geometric behavior. He then con- 
nected it to the full binary shift map a on infinite se- 
quences of Os and Is — that is, the map which simply 
substitutes the symbol at position i -I- 1 for that at po- 
sition i. The dynamics of a are very easy to grasp. In 
particular, it is easy to see that it has a countable infinity 
of periodic points of arbitrarily high period, an uncount- 
able infinity of non-periodic points, and a dense orbit. 
(Recall that rational numbers, which are countable, have 
repeating binary representations, while irrational num- 
bers, which are uncountable, never repeat.) The great 
trick, then, was to show that the horseshoe map / and 
the shift map a were topologically conjugate. That is, 
he found a continuous function (/) from a subset of the 
manifold M to the sequence space S which was one-to- 
one and onto, and which commuted with the two maps. 
(Symbolically, (j) o f = a o 0.) This meant that the dy- 
namical properties of the horseshoe map could be read 
off directly from those of the shift map. 

The attraction of symbolic dynamics should now be 
clear: we can, so to speak, factor the dynamics of interest 
into a clean, simple shift map (tr), and a messier, but 
less material, conjugacy map (</>). If, for instance, we 
could show that the shift map and the minority game 
are topological conjugate, or discern the mechanisms that 
prevent them from being conjugated, the dynamics of the 
minority game itself would be much more plain to us. 



B. Basic Notions 

We now will quote the relevant standard results with- 
out proofs, which may be found in e.g. Ref. 26]. Begin 
with a finite or countable alphabet X of symbols. Prom 
these we make strings or words over X, which are sym- 
bol sequences, X0X1X2 ■ ■ -Xn- Our shift space is a set of 
semi-infinite words, x = xqXiX2 . . .Xi . . . (i.e. we will be 
concerned with sequences on only one side of the deci- 
mal point). The dynamics are given by a shift operator 
T: Tx — X1X2 ■ ■ ■■ That is, {Tx)i = 2:^+1. The orbit of a 
point is its set of future iterates, {x, Tx, T^x, . . .}. 
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It is useful, and perhaps comforting, to invoke linear 
operators at this point. Let ^ be a square 0-1 matrix, 
with as many rows as X has symbols. Define a shift space 
Xa where x is allowed iff Vz, ^(^..^jj-.^j^-) = 1. Then Xa 
is a subshift of finite type and the matrix A corresponds 
to the shift operator T. We can also represent Xa with 
a directed graph Ga, where there is one node for each 
symbol, and an edge from i to j iff Aij — 1. Then x G Xa 
iff it is a path through Ga ■ The transition matrix is one- 
many if there are symbols i,j,k such that A^j — 1 and 
Ai]^ = 1 but j ^ k. A is many-one if there are «, j, k such 
that Aik = 1 and Ajk — 1 but i ^ j. And A is one-one 
if it is neither many-one nor one-many. 

We now have a space Xa of sequences, and some of the 
properties of this space will be useful later on. First, the 
standard metric between two sequences (points) x and y 
in the shift space is 



L generated by the dynamics. We then define the metric 
entropy rate or Kolmogorov-Sinai entropy as 



d{x,y) 



E 

i=0 



1 - 5{xi,yi) 



(1) 



where 5(a, h) is the Kronecker delta. Thus if x^ = yi 
for aU i < M, then d{x,y) < 2"^^. Conversely, if 
d{x, y) < 2^^^+^, then Xi = yi for all i < M. From this it 
follows that the sequence space, equipped with the stan- 
dard metric, is compact, totally disconnected and perfect 
(i.e., it is closed, and every point is a limit point). 



C. Entropies and Lyapunov Exponents 

It is now useful to deal with notions defining growth 
rates of a given space and spreading rates along orbits. 
This will be achieved via standard entropies and Lya- 
punov exponents borrowed from ergodic theory. In gen- 
eral, not all words are allowed, i.e., not every semi- infinite 
word is in the shift space. Likewise, many of the se- 
quences are never seen due to the particulars of the shift 
operator. If W{L) is the number of allowed words of 
length L, the topological entropy is 



lim -logT^(i) 

L — *^oo L 



(2) 



That is, h is the asymptotic exponential rate of growth 
in the number of allowed words. It measures the degree 
of exponential spreading in the dynamics. Normally, of 
course, that is measured by the Lyapunov exponents. As- 
suming those can be defined, the largest Lyapunov expo- 
nent Ai < h. (For specific conditions under which the 
Lyapunov exponents exist, see Refs. p^l30ll3]|.') 

The topological entropy gives equal weight to every 
possible word, no matter how improbable. If we wish 
to give more weight to the more probable strings, it is 
natural to start with the entropy over words of length L, 



H{L) = {-\ogVv{x[)) 



(3) 



lim 



H[L] 



(4) 



where () denotes expectation. This is the mean amount of 
information, in bits, required to specify a word of length 



In addition to being an important invariant of the dynam- 
ical system, the metric entropy rate can be thought of as 
the rate of information production — the rate at which 
new information is produced by the dynamics. Clearly, 
h > hfj, [s^ . Under certain conditions on / [30l 13^ l34| , 
is equal to the sum of the positive Lyapunov expo- 
nents; more generally it is a lower bound on their sum. 
Thus, a positive guarantees the existence of at least 
one positive Lyapunov exponent. The proofs of these as- 
sertions are somewhat complicated results from ergodic 
theory, well-summarized in Ref. |32|. 



D. Chaos 

We adopt the standard topological definition of chaos, 
due to Devaney [35l |. A compact set A, invariant under 
T, is chaotic if T is topological transitive on A, and its 
periodic orbits are dense in A. Topological transitivity 
means that the trajectory of any open set in A eventu- 
ally visits every other open set in A — we can get from 
one part of the region to any other. Together with the re- 
quirement of dense periodic orbits, this implies sensitive 
dependence on initial conditions. One can imagine the 
chaotic trajectories wandering between (but never on) 
the dense periodic orbits. Note that the periodic orbits, 
while dense, are not stable or attracting (3^. In fact, 
sensitive dependence on initial conditions, which we have 
just established, in turn implies exponential separation of 
nearby orbits, at least under fairly weak conditions, and 
hence a positive Lyapunov exponent and positive entropy 
rates. These, accordingly, constitute the numerical or ex- 
perimental signatures of chaos. 

For subshifts of finite type, all of this can be related 
to the matrix A (or the corresponding graph) very di- 
rectly. Xa is transitive if it has dense orbits. (N.B., 
not necessarily dense periodic orbits.) Xa is irreducible 
if for every pair of indices i and j, there is some I > 
for which > 0. (This is the same as Ga being 

strongly connected.) Now, if Xa is irreducible, then ei- 
ther it is transitive or it consists of a single periodic orbit. 
Likewise, if Xa is transitive, then A is irreducible. 



III. THE MINORITY GAME AS A SHIFT MAP 

To do one iteration of the minority game, we need to 
know two things. (1) The history of the last m rounds 
— which action won on each of them. (2) The "gains" of 
all the strategies possessed by the agents — the number 
of times each strategy predicted the winning action in 
the last m rounds. These facts fix the action of each 
agent, and so the winner of the round. That is, the next 
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state of the game is a deterministic function of its present 
state. (In what follows, "state" will always mean the 
global state of the game, never the state of an individual 
agent.) 

Since each state variable takes only finitely many val- 
ues, we can map the state as a whole into a finite alpha- 
bet. We order the states and their alphabetic symbols 
however we like. Then we build a square matrix A, where 
Aij = 1 if j follows i, and = otherwise. Xa defines a 
subshift of finite type over states of the minority game, 
and every run of the minority game is an allowed orbit 
of this subshift. We could write down A in some detail, 
but shan't. 

Suppose memory for gains extends back indefinitely. 
Then the state comes from a countably infinite alphabet, 
rather than a finite one, but the subshift is still deter- 
ministic (many-one). 

In the finite-memory case, the lack of chaos is elemen- 
tary once we realize that there are only finitely many 
states; the full apparatus of symbolic dynamics is over- 
kill. There are only finitely many symbols, so every string 
will eventually repeat a symbol. But each symbol has a 
unique successor, so after the first repetition, the string 
just repeats a single word. Hence every orbit is eventually 
periodic. 

The topological entropy rate is zero. The first symbol 
of a string fixes all subsequent ones, so VL, W{L) = 
W{1), and = by Eq.^J 



IV. COMPLEXITY IN THE MINORITY GAME 

Before we can say quantitative things about the com- 
plexity of a model, we must pick a complexity measure, 
of which there are many |25|. When people have dis- 
cussed the complexity of discrete games at all, they have 
picked the Kolmogorov complexity or "algorithmic infor- 
mation content" [33 ■ Kolmogorov introduced this con- 
cept as part of a definition of "randomness" relying on 
purely combinatorial notions, part of a long-standing pro- 
gram of research in the foundations of probability 'SSlj. 
The Kolmogorov complexity K{w) of a finite string w is 
the length of the shortest computer program which will 
produce that string as its output and then stop '6^. Be- 
cause any string can be produced by a program like print 
' ' w ' ' , the complexity of any string cannot be more than 
its length plus a constant (the length of the "print" in- 
struction). On the other hand, some strings can be pro- 
duced by programs which are much shorter than them- 
selves, e.g., a string of a million Os can be produced by 
iterating the command print ' '0' ' a million times. A 
random strings, roughly speaking, is one which cannot be 
generated by any program significantly shorter than the 
string itself. More exactly, if a:f are the first L symbols of 
an infinite word, and if (ccf )/n — > 1, then all the proper- 
ties which are true of a sequence of independent, identi- 
cally distributed random variables are true of the symbols 
in the infinite word. For deep reasons connected with the 



existence of uncomputable numbers, there can be no gen- 
eral procedure for computing the Kolmogorov complexity 
of arbitrary strings, nor are there any known procedures 
which give well-controlled approximations |37l [s^ . How- 
ever, if the symbols are generated by an ergodic process, 
there is an easy expression for the expected rate of growth 
in the complexity (if(a;f )) /L^h^asL^oo. 

This is another illustration of the fact that /i^j measures 
the rate of information production. 

While, as we have said, there is no real way to com- 
pute the Kolmogorov complexity, several papers in the 
physics literature have attempted to calculate it for 
games 0, E3| and even for real markets 0, , 
with the claim |45j | that the high complexity they obtain 
shows that financial time series contain much valuable 
information. Pace these authors, had they actually been 
able to calculate the algorithmic information content, a 
high value of it would indicate that the systems they con- 
sidered were basically random, because this is just what 
Kolmogorov complexity means. 

Assuming one wants a notion of "complex" which is 
not the same as "random" , what should a good complex- 
ity measure be like? As mentioned, many measures have 
been proposed p5|, but there is some consensus about 
what features a good measure should have. It should be 
low for both highly ordered and highly random systems; 
it should be calculable; and it should have a clear dynam- 
ical meaning, rather than just being a number for its own 
sake |4^. To our knowledge, only one measure satisfies 
all these criteria, the statistical complexity of Crutchfield 
and Young > a fully formalized and operational version 
of Grassberger's "4^ conjectural "true measure complex- 
ity" . It is the amount of information about the past of 
the system needed for maximally accurate prediction of 
its future 'i^ . 

We get the statistical complexity by finding the causal 
states of the system: each causal state is a distinct dis- 
tribution for future events, conditional on the past of the 
system. Abstractly, we find the conditional distribution 
Pr(xi°|a;'Loo) for each past x'^_^, and group pasts with 
the same distribution into states. The probability of a 
state is then the sum of the probabilities of all the pasts 
assigned to it, and the distribution conditional on the 
state is just the same as the distribution conditional on 
the individual pasts. (In practice, we use a number of re- 
cursive tricks to approximate the causal states from finite 
data, while only looking at the conditional distribution 
of the next symbol 50].) The statistical complexity 
is simply the entropy (uncertainty in bits) of the causal 
states = — Pi log2 Pi, where pi is the probability of the 
j**^ causal state. This is maximized when all causal states 
are equally probable. In the case of a periodic process, 
each phase is a causal state, and each state is equally 
probable, so = log2 P.|6^ 

We have just seen that the minority game has only 
periodic orbits, so to get C^, we just need the period. 
Start with just one strategy per agent. After the system 
has seen every possible history, it must repeat itself, so 
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P < 2™. Now give each agent several strategies. The 
number of ways agents can deploy strategies is S* < s^. 
When we've gone through every possible history, the 
agents could be using different strategies than before. 
But once we've seen all deployments of strategies, we 
must be back where we started. Thus P < 52™ < s^2™. 
Even these bad estimates give us 

Cf, < m + Nlog^s (5) 

The complexity grows linearly with memory and popula- 
tion at most. We get this growth rate only with complete 
(combinatorial) independence — an agent's strategy se- 
lection is constrained neither by the selections of other 
agents, nor even by the global history! 

In a number of recent papers, Savit, Parunak and col- 
laborators 's^, have considered a complexity mea- 
sure closely related to the statistical complexity (they do 
not give it a name). In essence, following [54|, they treat 
two pasts as belong to the same state if and only if they 
they lead to the same unique next symbol, whereas statis- 
tical complexity requires only that they lead to the same 
distribution of future symbols. The two complexities co- 
incide for periodic processes. In the presence of noise, 
however, the method of Savit et al. will be forced to rely 
on longer and longer histories, until it finds ones that 
look deterministic simply because of undersampling, and 
their complexity will diverge logarithmically in the size of 
their data set ^5.5j . The statistical complexity, however, 
is well-behaved in the presence of noise (see Section IVII 
below) . 

V. INFINITE MEMORY FOR GAINS 

People sometimes play the minority game with an in- 
finite memory for gains — agents remember the number 
of times each strategy has won since the beginning of the 
game, rather than just in the last m turns. Then the 
alphabet is countably infinite. But what matters are the 
difference in strategies' gains, and if those are bounded, 
the finite-state arguments take over. Even when differ- 
ences in gains are unbounded, the shift map is many-one, 
so there is just a single 1 in each row of the transition 
matrix T. 

The topological entropy rate of a countable-state shift 
is (3, Observation 7.2.10] 

h = limsup-^(r"),, , (6) 

n — >oo ri 

3 

independent of i. From many-oneness, the sum in Eq. 
is always exactly 1, so /i = 0. 

Let us consider also the question of exponential spread- 
ing. 

The distance between points in the standard metric 
is at most 2. d{x,y) = 2 iS Xi ^ yi for all i. In that 
case, d{T^x, T^y) = 2 for all n, so maximally-separated 
points stay maximally separated. On the other hand, if 



the distance between x and y is less than 2, then at some 
position, fc, Xk = yk- By the many-oneness of the shift, 
if j > k, Xj ~ yj. Therefore, the distance between the 
iterates of x and y shrinks until it hits 0. Distance never 
increases; spreading of any sort, never mind exponential 
spreading, is impossible. 

The distance between any two distinct periodic points 
is always maximal; that is, given two periodic points x 
and y, if X ^ y, then Xi ^ yi for all i. To see this, consider 
first the case of two points on the same periodic cycle, 
of period P. For some < L < P, T^{x) = y. Suppose 
that, for some k, Xk = yk- Then T''x = T'^y = T''+^x, so 
T^x is periodic with period L < P, which is absurd. Now 
consider points on two distinct periodic cycles. Suppose 
there were a k such that Xk = yk- Then T^{x) — T^{y). 
Hence there is a point, T^{x), belonging both to the x 
cycle and the y cycle. But this is absurd, because the 
cycles are distinct. 

Suppose periodic points were dense. Then for any 
point x and any distance e > 0, there would be a pe- 
riodic point y ^ X such that d{x, y) < e. But if x is itself 
periodic, then we have just seen that d{x, y) = 2 no mat- 
ter what periodic point y we chose. Therefore periodic 
points are not dense. Chaotic maps have dense periodic 
points, so this shift map isn't one. 

VI. NOISE 

Traditionally, the minority game is played somewhat 
noisily — either players chose strategies with some de- 
gree of randomness, or the move they make, once they 
have chosen a strategy, is somewhat random. This makes 
the game amenable to statistical- mechanical treatment, 
a point which has been thoroughly explored elsewhere. 
Here, we will see that it can make the entropy rate posi- 
tive, but does not increase the complexity. 

The usual types of noise imposed in discrete games 
change them from deterministic maps into Markov 
chains. This means we can represent the state of the 
game at one time as a function of the state at the previ- 
ous time, and a sequence of stationary, independent noise 
variables, i.e., xt+i = /{xtTrjt), where {rjt} are IID ran- 
dom variables which are also independent of the Xt- The 
Markov property of the sequence {xt} also means that its 
entropy rate (metric or topological) is just the entropy of 
Xt+i conditional on xt 26, 3^. That is, /i^ = iJ[a;(+i |a:;t], 
and similarly for h. Now, applying some basic results of 
information theory js^ ch. 2], 

H[xt+i\xt] = H[f{xt,rit)\xt] 
< H[xt,rit\xt] 
= H[Tjt\xt] ^ H[r]t] 

Or, in words: because the only source of randomness 
is the noise, the entropy rate of the states must be no 
more than the entropy of the noise. A parallel argument 
holds for the topological entropy. Nothing in the process 
amplifies the noise. 
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Now let us consider the statistical complexity. Recall 
that a causal state is a distinct distribution of the sys- 
tem's future behavior, conditional on its past. For noise 
of the sort described, the present state of the game de- 
termines the distribution of future symbols, independent 
of any other feature of the past of the system. So the 
present symbol fixes the causal state. The noise could 
make some causal states more likely than others (reduc- 
ing the complexity), or could even lead to two symbols 
having the same distribution over future orbits, merg- 
ing them into a single causal state (again lowering the 
complexity). Adding noise simplifies matters, if it does 
anything at all. 



VII. CONCLUSIONS 

We analyzed the global behavior of discrete adaptive 
games, using symbolic dynamics. These games are not 
chaotic, and the most popular ones are actually of low 
complexity, at most linear in the number of agents. 

The crucial obstacles to chaos were that the state of the 
minority game can be summarized in a discrete alphabet, 
and that the evolution of those states is many-one. Our 
results will apply, mutatis mutandis, to any determinis- 
tic adaptive game of which this is true, for instance, the 
El Farol problem, and various discrete market models. 
To repeat, this is not an artifact of discretizing contin- 
uous models, but a feature of deliberately discrete ones. 
Nothing depends on the meta-strategy; our results hold 
with learning, imitation, evolution, etc., so long one im- 
plements them non-anticipatively. 



A. Exponential Spreading versus Exponential 
Transients 

Anyone who looks at a simulation of the minority game 
sees an intricate, hard-to-predict process — we certainly 
do. Scientists trained in nonlinear dynamics naturally 
look to exponential divergence of orbits to explain these 
observations. We have seen that there is no such diver- 
gence in the standard, noiseless version of these games; 
there are three ways to get it. 

• Hidden information. If only some agents have ac- 
cess to a (changing) outside source of information, 
then there can be apparent transitivity in the game, 
and so deterministic chaos. A neat example is the 
Brock-Hommes asset-trading model [s^ Is^, Issj . 
where agents get simple adaptive strategies for free, 
but must pay for rational expectations of future 
prices. 

• Add noise. As we've seen ('Sec. IVI|I . this certainly 
allows exponential divergence, but in a trivial way, 
and at a cost in complexity. 



• Coupling to chaos. Break ties using a chaotic shift 
map, or something similar. Often this will make 
the game chaotic. 

Only the first of these mechanisms has any economic rel- 
evance. In real markets, information is expensive, but 
transparency is prohibitively expensive, and so hidden 
information is ubiquitous. Exploring the consequences 
of this is an important problem of great economic in- 
terest; indeed, the problem is common across almost all 
social situations. The other methods, by contrast, are 
"unphysical," lacking in substantive content. Of course, 
hidden information cannot explain the phenomenology of 
games in which it is absent, but it is no less interesting 
on that account. 

What however does account for that phenomenology? 
We suggest that the answer is exponentially fast diver- 
gence, but rather exponentially slow convergence. For 
the minority game, it is numerically well established that 
relaxation times grow exponentially with m |5^. What 
is less appreciated is that, in high-dimensional dynami- 
cal systems, the approach to the attractor can be so slow 
that it is never reached in simulations, at least not within 
the lifespan of ordinary experimenters (but see jl^l)- In 
systems formed by coupling smaller dynamical systems, 
such as the agents in our games, the duration of the tran- 
sient epoch often grows exponentially with the number 
of agents [bJI- The attractors and their invariant dis- 
tributions are irrelevant; what matters is the structure 
of the attractor basin [GjI and the quasi-stationary tran- 
sient distribution it produces [63l|. Once recognized, these 
long transients are actually a feature of discrete adap- 
tive games, since the social systems they are supposed 
to model are essential ly n ever in an invariant state, but 
always "in transition" [Sg • The transients are, however, 
bad news for methods based on either ergodic or thermo- 
dynamic limits. Quantities like the entropy rate and the 
Lyapunov exponents, which are rigorously defined only 
in the limit, loose much of their interest. 

B. Directions for Future Work 

The motive for studying models like the minority game 
should not be that they are complex systems in some for- 
mal sense. In any area of modeling, formal constructs ac- 
quire interest from their ability to help resolve problems 
of physical relevance — that is, here, social relevance. We 
have argued that such constructs as algorithmic complex- 
ities and stationary and thermodynamic limits have not 
demonstrated such relevance here, and are unlikely to do 
so in the future. By contrast, the distinctively transient 
dynamics of such systems, especially their basin struc- 
ture, hold great promise for understanding the origins 
of complex behavior we see in these games. The hope 
of econophysics is that these models portray, in stylized 
miniature, key aspects of real mutual adaptation and so- 
cial interaction, and that studying the portrait will help 
us understand the original. This is not an outlandish 
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hope, since profound insights have come from study- 
ing the equally-styhzed Prisoners' Dilemma [g^, and a 
host of other, less famous models 0, IE have illumi- 
nated the collective life of political, boundedly-rational 
animals. Wc hope that the discrete adaptive games of 
econophysics will take their place in this set. The contri- 
bution of econophysics, it seems to us, be to assimilate 
the rich body of empirical findings and models of indi- 
vidual choice and learning, and say something distinc- 
tive and illuminating about how large numbers of such 
boundedly-rational agents interact. 



Matt Jones, Cris Moore, Scott Page, Van Parunak, 
Robert Savit, Kris Shalizi, Clint Sprott and Libby Wood 
for valuable conversation and suggestions. CRS also 
thanks Kris Shalizi for being perfect. Our work at SFI 
was supported by the Dynamics of Learning program, 
under DARPA cooperative agreement F30602-00- 2-0583, 
and CRS's work at Ann Arbor by a grant from the James 
S. McDonnell Foundation. 



Acknowledgments 

We thank Sam Bowles, Sven Brueckner, Jim Crutch- 
field, Dee Dechert, Richard Gonzalez, Cars Hommes, 



[1] J. von Neumann and O. Morgenstern, Theory of Games 
and Economic Behavior (Princeton University Press, 
Princeton, 1944). 

[2] H. Gintis, Game Theory Evolving: A Problem-Centered 
Introduction to Modeling Strategic Interaction (Princeton 
University Press, Princeton, 2000). 

[3] D. Kahneman, P. Slovic, and A. Tversky, eds., Judgment 
Under Uncertainty (Cambridge University Press, Cam- 
bridge, England, 1982). 

[4] C. Camerer, in The Handbook of Experimental Eco- 
nomics, edited by J. H. Kagel and A. E. Roth (Princeton 
University Press, Princeton, New Jersey, 1995), pp. 587- 
703. 

[5] H. A. Simon, The Sciences of the Artificial (MIT Press, 
Cambridge, Massachusetts, 1996), 3rd ed., first edition 
1969. 

[6] A. Rubinstein, Modeling Bounded Rationality (MIT 
Press, Cambridge, Massachusetts, 1999). 

[7] H. P. Young, Individual Strategy and Social Structure: 
An Evolutionary Theory of Institutions (Princeton Uni- 
versity Press, Princeton, 1998). 

[8] G. Klein, Source of Power: How People Make Decisions 
(MIT Press, Cambridge, Massachusetts, 1998). 

[9] C. E. Zsambok and G. Klein, eds., Naturalistic De- 
cision Making, Expertise: Research and Applications 
(Lawrence Erlbaum Associates, Mahwah, New Jersey, 
1997). 

[10] G. Gigerenzer, P. M. Todd, and the ABC Re- 
search Group, Simple Heuristics That Make Us Smart 
(Oxford University Press, Oxford, 1999). 

[11] G. Gigerenzer and R. Selten, eds.. Bounded Rational- 
ity: The Adaptive Toolbox (MIT Press, Cambridge, Mas- 
sachuetts, 2001). 

[12] H. A. Simon, Quarterly Journal of Economics 69, 99 
(1955), reprinted in [3. 

[13] H. A. Simon, Psychological Review 63, 129 (1956), 
reprinted in 

[14] H. A. Simon, Models of Bounded Rationality (MIT Press, 

Cambridge, Massachuetts, 1982). 
[15] D. Challet and Y.-C. Zhang, Physica A 246, 407 (1997), 

URL arxiv . org/abs/cond-mat/gTOSOOe. 



[16] J. L. Myers, in Approaches to Human Learning and Mo- 
tivation, edited by W. K. Estes (Lawrence Erlbaum As- 
sociates, Hillsdale, New Jersey, 1976), vol. 3 of Handbook 
of Learning and Cognitive Processes, pp. 171-205. 

[17] P. Jefferies, M. L. Hart, and N. F. Johnson, 
Physical Review E 65, 016105 (2002), URL 
arxiv . org/ abs/ cond- mat /O 103259 

[18] P. Jefferies, D. Lamper, and N. F. Johnson, Anatomy 
of extreme events in a complex adaptive system (2002), 
URL arxiv . org/abs/cond-mat/0201540 

[19] W. B. Arthur, Increasing Returns and Path Dependence 
in the Economy (University of Michigan Press, Ann Ar- 
bor, 1994). 

[20] J. Guckenheimer and P. Holmes, Nonlinear Oscillations, 
Dynamical Systems and Bifurcations of Vector Fields 
(Springer- Verlag, New York, 1983). 

[21] R. L. Devaney, A First Course in Chaotic Dynamical Sys- 
tems: Theory and Experiment (Addison- Wesley, Read- 
ing, Mass., 1992). 

[22] K. T. Alligood, T. D. Sauer, and J. A. Yorke, Chaos: 
An Introduction to Dynamical Systems (Springer- Verlag, 
Berlin, 1996). 

[23] R. C. Hilborn, Chaos and Nonlinear Dynamics: An In- 
troduction for Scientists and Engineers (Oxford Univer- 
sity Press, Oxford, 1994). 

[24] S. Wiggins, Introduction to Applied Nonlinear Dynamical 
Systems and Chaos (Springer Verlag, Berlin, 1990). 

[25] R. Badii and A. Politi, Complexity: Hierarchical Struc- 
tures and Scaling in Physics (Cambridge University 
Press, Cambridge, 1997). 

[26] B. P. Kitchens, Symbolic Dynamics: One-sided, Two- 
sided and Countable State Markov Shifts (Springer- 
Verlag, Berlin, 1998). 

[27] B.-I. Hao and W.-M. Zheng, Applied Symbolic Dynamics 
and Chaos (World Scientific, Singapore, 1998). 

[28] S. Smale, in Differential and Combinatorial Topology: A 
Symposium in Honor of Marston Morse, edited by S. S. 
Cairns (Princeton University Press, Princeton, New Jer- 
sey, 1965), pp. 63-80. 

[29] D. Ruelle, Annals of Mathematics 115, 243 (1982). 

[30] Y. Pesin, Russian Mathematical Surveys 32, 55 (1977). 



8 



A. B. Katok, Publications Mathematiques de I'Institut [51 
des Hautes Etudes Scientifiques 51, 137 (1980). 
A. B. Katok and B. Hasselblatt, Introduction to the Mod- 
em Theory of Dynamical Systems (Cambridge University [52 
Press, Cambridge, England, 1995). 

D. Ruelle, Boletim da Sociedade Brasileira de Matemat- 
ica 9, 83 (1978). [53 
G. A. Margulis, Functional Analysis and Applications 3, 
335 (1969). 

J. Banks, J. Brooks, G. Cairns, G.Davis, and P. Stacy, 
American Mathematical Monthly 99, 332 (1992). [54 
S. Smale, Bulletin of the American Mathematical Society [55 
73, 747 (1967). 

M. Li and P. M. B. Vitanyi, An Introduction to Kol- 
mogorov Complexity and Its Applications (Springer- [56 
Verlag, New York, 1993). 
J. von Plato, Creating Modem Probability: Its Math- [57 
ematics, Physics and Philosophy in Historical Perspec- 
tive (Cambridge University Press, Cambridge, England, [58 
1994). 

T. M. Cover and J. A. Thomas, Elements of Information 
Theory (Wiley, New York, 1991). 

A. A. Brudno, Uspekhi Matematicheski Nauk 33, 207 
(1978). [59 
R. Mansilla, Complex Systems 11, 387 (1997). 
R. M ansilla, Physical Review E 62, 4553 (2000), URL [60 
[eirxiv . org/abs/cond-mat/9906017 [61 
R. Mansilla, Physica A 284, 478 (2000), URL 
|arxiv.org/abs/cond-mat/0002331 [62 
R. Mansilla, Physica A 301, 483 (2001), URL 
|arxiv. org/abs/cond-mat/0104472 

R. N. Mantegna and H. E. Stanley, An Introduction 
to Econophysics: Correlations and Complexity in Fi- [63 
nance (Cambridge University Press, Cambridge, Eng- 
land, 2000). [64 
D. P. Feldman and J. P. Crutchfield, Physics Letters A 
238, 244 (1998). [65 
J. P. Crutchfield and K. Young, Physical Review Letters 
63, 105 (1989). [66 
P. Grassberger, International Journal of Theoretical 
Physics 25, 907 (1986). [67 
C. R. Shalizi and J. P. Crutchfield, Journal 
of Statistical Physics 104, 817 (2001), URL 
arxiv. org/ abs/ cond-mat/9907176 

C. R. Shalizi, K. L. Shalizi, and J. P. Crutchfield, Journal [ 
of Machine Learning Research submitted (2002), URL 
larxiv . org/abs/cs . L G/0210025| 



R. Savit, S. A. Brueckner, H. V. D. Parunak, 
and J. Sauter, Tech. Rep., Altarum (2002), URL 
[www ■ er im ■ org/~ vparunak/RAGpaper . pdf 
R! Savit, S. A. Brueckner, H. V. D. Parunak, and 
J. Sauter, Physics Letters A submitted (2003), URL 
arxiv . org/abs/nlin . AO/0302053 

H. V. D. Parunak, S. A. Bruecker, J. Sauter, 
and R. Savit, in Autonomous Agents and 
Multt- Agent Systems 2002 (2002), URL 
www. erim. org/" vparunak/AAMAS02Ef fort .pdf 
R. Savit and M. Green, Physica D 50, 95 (1991). 
K. Marton and P. C. Shields, Annals of Probability 23, 
960 (1994), see also an important Correction, Annals of 
Probability, 24 (1996): 541-545. 

W. A. Brock and C. H. Hommes, Journal of Economic 

Dynamics and Control 22, 1235 (1998). 

W. A. Brock and C. H. Hommes, Econometrica 65, 1059 

(1997). 

W. A. Brock and C. H. Hommes, in The Theory 
of Markets, edited by P. Herings, A. Talman, and 
G. van der Laan (North Holland, for the Royal Nether- 
lands Academy of Arts and Sciences, Amsterdam, 1999) , 
pp. 109-137. 

M. Marsili and D. Challet, Physical Review E 64, 056138 
(2001), URL arxiv.org/abs/cond-mat/0102257 
F. J. Dyson, Reviews of Modern Physics 51, 447 (1979). 
J. P. Crutchfield and K. Kaneko, Physical Review Letters 
60, 2715 (1988). 

A. Wuensche and M. Lesser, The Clobal Dynamics of Cel- 
lular Automata: An Atlas of Basin of Attraction Fields of 
One-Dimensional Cellular Automata (Addison- Wesley, 
Reading, Massachusetts, 1992). 

J. P. Crutchfield, Nuclear Physics B, Proceedings Sup- 
plements 5A, 287 (1988). 

R. Axelrod, The Evolution of Cooperation (Basic Books, 
New York, 1984). 

T. C. Schelling, Micromotives and Macrobehavior (W. 
W. Norton, New York, 1978). 

We will ignore some subtleties relating to the choice of 
programming language, which do not affect the argument 
For non-periodic processes, 2^^^ is the geometric average 
of the expected recurrence times of the causal states, i.e., 
still the average amount of time needed to return to a 
state after leaving it. 

This does not mean they are never in equilibrium, in the 
economists' sense, however. 



